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Abstract 

Recent research has shown the link between congestion control in communi- 
cation networks and feedback control system. In this paper, the design of an active 
queue management (AQM) which can be viewed as a controller, is considered. 
Based on a state space representation of a linearized fluid flow model of TCP, the 
AQM design is converted to a state feedback synthesis problem for time delay 
systems. Finally, an example extracted from the literature and simulations via a 
network simulator NS (under cross traffic conditions) support our study. 



1 Introduction 

Congestion control is a very active research area in network community. In order to 
supply the well known transmission control protocol (TCP), active queue management 
mechanisms have been developed. AQM regulates the queue length of a router by ac- 
tively dropping packets. Various mechanisms have been proposed in the literature such 
as Random Early Detection (RED) |4|, Random Early Marking (REM) 1 1], Adaptive 
Virtual Queue (AVQ) 1 10] and many others 1 19 |. Their performances have been evalu- 
ated in 1 19] and empirical studies have shown their effectiveness (see lfT2l ). Recently, 
significant studies proposed by |7| have redesigned the AQMs using control theory and 
P, PI have been developed in order to cope with the packet dropping problem. Then, 
using dynamical model developed by [16], many research have been devoted to deal 
with congestion problem in a control theory framework (for example see |22|). Never- 
theless, most of these papers do not take into account the delay and ensure the stability 
in closed-loop for all possible delays which could be conservative in practice. 
Modeling the congestion control using time delay is not new and global stability anal- 
ysis has been studied by ifTsl and ifTTl via Lyapunov-Krasovskii theory. Also, in ||9l, 
a delay dependent state feedback controller is provided by compensation of the delay 
with a memory feedback control. This latter methodology is interesting in theory but 
hardly suitable in practice. 

Based on a recently developed Lyapunov-Krasovskii functional, an AQM stabilizing 
the TCP model is designed. This synthesis problem is carried out as state feedback 
synthesis for time delay systems. Then, this method is applied on an augmented sys- 
tem in order to vanish the steady state error in spite of disturbance. 
The paper is organized as follows. The second part presents the model of a network 
supporting TCP and the time delay system representation. Section[3]is dedicated to the 
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Figure 1 : Network configuration 



design of the AQM ensuring the stabihzation of TCP. Section|4]presents application of 
the exposed theory and simulation results using NS-2 (see Q) before concluding this 
work. 

2 Problem statement 

2.1 The linearized TCP fluid-flow model 

In this paper, we consider the network topology consisting of N homogeneous TCP 
sources (i.e with the same propagation delay) connected to a destination node through a 
router (see figure[T]l. The bottleneck link is shared by N flows and TCP applies the well 
known congestion avoidance algorithm to cope with the phenomenon of congestion 
collapse |8 |. Many studies have been dedicated to the modeling of TCP and its AIMD 
(additive-increase multiplicative-deacrease) behavior |13|, (21], f22] and references 
therein. We consider in this note the model ([T]i developed by 1 16|. This latter may not 
capture with high accuracy the dynamic behavior of TCP but its simplicity allows us to 
apply our methodology. Let consider the following model 



where W is the TCP window size, q is the queue length of the router buffer, R is the 
round trip time (RTT) and can be expressed as i? = g/C + Tp. C, Tp and N are pa- 
rameters related to the network configuration and represent the transmission capacity 
of the router, the propagation delay and the number of TCP sessions respectively. The 
variable p is the marking/dropping probability of a packet (that depends whether the 
ECN option, explicit congestion notification, is enabled, see 1181 ). In the mathematical 
model ([T]i, we have introduced an additional signal d{t) which models cross traffics 
through the router and filling the buffer. These traffics are not TCP based flows (not 
modeled in TCP dynamic) and can be viewed as perturbations since they are not reac- 
tive to packets dropping (for example, UDP based traffic). A linearization and some 
simplifications of ([T]l was carried out in [7 1 to allow the use of traditional control theory 
approach. The linearized fluid-flow model of TCP is as follow. 



where SW ^ W — Wq, 6q ^ q — qq and 6p = p — po are the perturbated variables 
about the operating point. The operating point (W^o, qo,Po) is defined by 
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Figure 2: Design of an AQM as a state feedback 



The input of the model (|2]l corresponds to the drop probability of a packet. This proba- 
bility is fixed by the AQM. This latter has for objective to regulate the queue size of the 
router buffer. In this paper, this regulation problem is addressed in Section [5] with the 
design of a stabilizing state feedback for time delay systems. Indeed, an AQM acts as a 
controller (see figure|2]) and in order to design it, we have to solve a synthesis problem. 
Considering a state feedback, the queue management strategy of the drop probabiUty 
will be expressed as 

p{t)=po + kiSW{t) + k2Sq{t). (3) 

where fci and k2 are the components of the matrix gain K which we have to design. 
Note that the input = u{t) + po of the system (|4| is delayed. 



2.2 Time delay system approach 

In this paper, we choose to model the dynamics of the queue and the congestion window 
as a time delay system. Indeed, the delay is an intrinsic phenomenon in networks and 
taking into account its characteristic should improve the precision of our model with 
respect to the TCP behavior. 

The linearized TCP fluid model ^ can be rewritten as the following time delay system: 

J x{t) = Ax{t) + Adx{t -h) + Bu{t -h) + Bdd{t) 

I XQ{d) = (j){e), with e e [-h, 0] ^ ' 

with 

(5) 

Bd = [0 1]^, x{t) = [5W{t) 5q{t)]^ is the state vector and u{t) = 5p{t) the input. 

is the initial condition. 
There are mainly three methods to study time delay system stability: analysis of the 
characteristic roots, robust approach and Lyapunov theory. The latter will be consid- 
ered because it is an effective and practical method which provides LMI and BMI 
(Linear/Bilinear Matrix Inequalities, |2 |) criteria. To analyze and control the system 
(|4]l, the Lyapunov-Krasovskii approach (see |6j|) is used which is an extension of the 
traditional Lyapunov theory. 
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3 Stabilization: design of an AQM 

In Section |2] the model of TCP/ AQM has been addressed as time delay system. The 
congestion problem needs the construction of a controller which regulates the buffer 
queue length. In this section, we are first going to present a delay dependent stability 
analysis condition for time delay systems. Then, based on this criterion, a synthesis 
method to derive a stabilizing state feedback is deduced. 



3.1 Stability analysis of time delay systems 



In this subsection, our goal is to derived a condition which takes into account an up- 
perbound of the delay. The delay dependent case starts from a system stable without 
delays and looks for the maximal delay that preserves stability. 

Usually, all methods involve a Lyapunov functional, and more or less tight techniques 
to bound some cross terms and to transform system |6 1. These choices of specific Lya- 
punov functionals and overbounding techniques are the origin of conservatism. In the 
present paper, we choose a recently developed Lyapunov-Krasovskii functional Q [|5] : 
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where P G S" is a positive definite matrix, Q G S''" and i? G S" are two positive 
definite matrices, r > 1 is an integer corresponding to the discretization step. Using 
this functional. Let us introduce the following proposition. 

Proposition 1 If there exist symmetric positive definite matrices P, R £ R"^", Q E 
prn X rn^ ^ scalar h„i > and an integer r > 1 such that 
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where 



(8) 



and 



S=[-l A 0,x(,_i)n Ad ] 
then, system (with u(t) — and dit) — 0) is stable for all h < km- 
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Proof: It is always possible to rewrite (|4]i as 5*^ = where 
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and S is defined as (|9]l. Using the extended variable ^(i) (fTOl i. the derivative of V 
along the trajectories of system (01 leads to: 
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where F e S^'^^^-'" depends on P, R, Q and the delay h. 

Using projection lemma ll20l . expression (fT2] i is equivalent to O. 

Remark 1: 

• There exists another equivalent form of this LMI provided in (5] and based on 
quadratic separation. 

• In the same paper, it is shown that for r — 1, this proposed function ^ is 
equivalent to the main classical results of the literature. Moreover, it is also 
proved that for r > 1 conservatism is reduced. 



3.2 A first result on synthesis 

Given the analysis condition O and applying the delayed state feedback ^ on sys- 
tem (lUi (in this subsection, the disturbance is not taken into account), the following 
proposition is obtained. 

Proposition 2 // there exist symmetric positive definite matrices P, R E R"^", Q G 
prnxrn^ matrix X G R(r+2)nxn^ ^ scalar h„i > 0, an integer r > 1 and a matrix 
if G R"^^" such that 

r + X5 + S'^X^<0 (13) 

where T is defined as dSf and 

S=[-l A 0,x(,_i)„ Ad + BK] (14) 

then, system can be stabilized for all h < hmfor the control law u(t) — Kx{t) 
(andford{t) ~ 0). 



Proof: Considering the system (|4]i with the state feedback (|3]i, the following intercon- 
nected system is deduced 

i{t) = Ax{t)+Adx(t-h), (15) 

where Ad = Ad + BK and A, Ad and B are defined as (|5]i. Then, we can apply 
the analysis condition (|7]i on ( fTSl l. Using Finsler lemma ll20l . there exists a matrix 
X G R('-+2)nxn ^^^.j^ ^^^ax if is Satisfied then d?) is true. Matrix X is called "slack 
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Figure 3: Design of an AQM as a dynamic state feedback 



variables"which can reduced conservatism and may be interesting for synthesis pur- 
pose as well as robust control purpose. 
Remark 2: 

• To solve the synthesis criterion (fTSl l. one has to use a BMI solver. 

• In ifTTI . a relaxation algorithm is provided with LMI condition to find a stabiliz- 
ing state feedback. 



3.3 Delay dependent state feedback with an integral action 

In the previous section, the design of a state feedback control for time delay systems 
has been exposed. The use of a such controller has been carried out in 1 11 1. However, it 
appears that in some cases, the queue size is no longer regulated at the desired level (this 
phenomenon is only observed on the network simulator NS). It thus appears a slight 
steady state error which can be explain by an inaccuracy of the model. Futhermore, the 
introduction of non responsive flows like UDP (user datagram protocol) traffics which 
appear as a disturbance affects the queue size equilibrium and changes the steady state. 
In order to overcome these problems, the AQM is supplemented with an integral action. 
The idea is to apply the previously exposed synthesis method over an augmented time 
delay system composed of the original system (|4]i and an integrator (see figure[3]l. The 
augmented system has the foUowing form 
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with = [5W 6q u]'^ is the extended state variable. Then, the global control which 
correspond to our AQM, is a dynamic state feedback 
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= ki6W{t) + k2Sq{t) + k3 / Sq{t)dt. 



(17) 



In our problem, non modelled crossing traffics d{t) such as UDP based applica- 
tions are introduced as exogenous signals (see figures|2]and[3]l. The queue dynamic is 
modified as 



m = ^N-c+dit) 



(18) 



Considering equations ( fTTb . the first equation of (|2]l and (fTsT l. we obtain the transfer 
function T{s) from the disturbance D{s) to the queue size (about the operating point) 
AQ(s): 

ns) = — j-^^ T' ^''^ 

(s + ^)sbis) + ^ [^(1 _ e-'^») + a{s)sk2 + ais)ks\ 

with a{s) = -^^e-''" and b{s) = s + -^(1 + e'^') + a{s)ki. It can be easily 
shown that for a step type disturbance, the queue size still converges to its equilibrium. 

3.4 Estimation of the congestion window 

In these last two parts, a state feedback synthesis has been performed for the conges- 
tion control of TCP flows and the management of the router buffer So far we have 
considered that the whole state was accessible. However, although the congestion win- 
dow can be measured in NS (few lines have to be added in the TCP code), it is not the 
case in reality. That's why, in this paper it is proposed to estimate this latter variable 
using the aggregate flow incoming to the router buffer. The sending rate of single TCP 
source can be approximated by 

..(,) ^ (20, 

The above approximation is valid as long as the model does not describe the commu- 
nication at a finer time scale than few round trip time (see |fT3l ). Consequently, the 
whole incoming rate observed by the router is x{t) = NW{t)/ R{t). The measure of 
the aggregate flow has already been proposed and successfully exploited in |10| and 
191 for the realization of the AVQ and a PID type AQM respectively. It is worth noting 
that queue-based AQMs like RED or PI can be assimilated as output feedbacks accord- 
ing to the queue length. Conversely, AVQ can be viewed as an output feedback with 
respect to the aggregate flow, belonging thus to the rate-based AQM class. 



4 NS-2 simulations 

As a widely adopted numerical illustration extracted from f7^ (see figure [T| for the 
network topology), consider the case where qo — 175 packets, Tp — 0.2 second and 
C — 3750 packets/s (corresponds to a 15 Mb/s link with average packet size 500 bytes). 
Then, for a load of iV = 60 TCP sessions, we have Wq = 15 packets, po = 0.008, 
i?o = 0.246 seconds. According to the synthesis criteria presented in Section [3] the 
state feedback matrices 



IQ- 



-0.2372 
0.0429 



and KsFi — 10 



0.9385 
0.5717 
0.3559 



(21) 



are calculated for the construction of the control laws ^ and (fTTl l respectively. 
We aim at proving the effectiveness of our method using NS-2 |3|, a network simulator 
widely used in the communication networks community. Taking values from the previ- 
ous numerical example, we apply the new AQM based on a state feedback. The target 
queue length qq is 175 packets while buffer size is 800. The average packet length is 
500 bytes. The default transport protocol is TCP-New Reno without ECN marking. 
For the convenience of comparison, we adopt the same values and network configura- 
tion than |7 | who design a PI controller {Proportional-Integral). This PI is configured 



as follow, the coefficients a and b are fixed at 1.822e — 5 and 1.816e — 5 respectively, 
the sampling frequency is 160Hz. The RED has been also tested using the parametric 
configuration recommended in 1 7 1 . In figure |4] simulations are performed under an ex- 
ternal perturbation. This latter is composed of 7 additional sources (CBR applications 
over UDP protocol) sending 1000 bytes packet length with a IMbytes/s throughput 
between t = 40s and t = 100s. The two DSF (see figure |4] for the DSF based on 
the congestion window and the aggregate flow) regulate faster than others and are able 
to reject the disturbance swiftly. Conversely, figure |4] shows the time response of the 
queue length with a simple state feedback Ks i? (I3]l as an AQM. One can note that the 
queue is stabilized slightly above the desired level (around 200 pkts). Futhermore, the 
non reponsive cross traffic affects the steady state. The table [T] summarizes the benefits 
of the two KsFi AQMs (according to simulations with UDP cross traffics). Classical 
statistical characteristics are calculated during the whole simulation, then only during 
the UDP cross traffic and finally after the UDP cross traffic (come back to steady state). 
These characteristics are mean, standard deviation (Sdt) and the square of the variation 
coefficient (CV2 = {Std/meanY). This latter calculation assess the relative disper- 
sion of the queue length around its mean. The mean points out the control precision 
and the standard deviation shows the ability of the AQM to keep the queue size close 
to its equilibrium. In table [T] we can observe that KsFi{cwnd) maintains a very good 
control on the buffer queue during the whole simulation. Even though KsFi{o-ggfl) 
is slightly slower than the previous one, statistics (Std and CV2) show again a good 
regulation. Although PI reject the perturbation quite fast, extensive fluctuations appear 
during the steady state. To conclude, the two DSF are efficient AQMs which provide 
the best precision and are able to regulate faster and closer to the mean compared to oth- 
ers AQMs. To complete our simulation, we propose another NS-2 simulation between 
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PI 


KsF 


KsFI 

(cwnd) 


KsFI 

(aggfl) 




Mean 


235.7 


176.7 


263.9 


175.9 


175.5 


B 


Sdt 


112.40 


71.19 


78.59 


54.57 


63.64 


B 


CV2 


0.227 


0.162 


0.088 


0.096 


0.131 


B 


Mean 


270.3 


178.3 


338.0 


173.4 


175.6 


D 


Sdt 


57.39 


40.42 


41.21 


35.08 


28.32 


D 


CV2 


0.045 


0.051 


0.014 


0.040 


0.026 


D 


Mean 


201.4 


177.8 


236.0 


176.2 


174.8 


A 


Sdt 


22.24 


36.64 


30.48 


30.22 


32.64 


A 


CV2 


0.012 


0.042 


0.016 


0.029 


0.034 


A 



Table 1 : Statistical characteristics for different AQMs (units are pkts) at different peri- 
ods (B, D and A: before, during and after CBR applications) 

different AQMs: REM, AVQ, RED, PI, KSFI(cwnd) and KSFI(aggfl). We consider 
different levels of CBR cross traffics (13 sources, 1Mb). RED, REM, PI and AVQ are 
fixed to same values as in [TTl, which is a performance analysis of AQM under DoS 
attacks. The additional sources are sending 1000 bytes packet length with a IMbytes/s 
throughput between t = 6Gs and t = 180s. The simulation is illustrated in the fig- 
ure |5] In these last two cases, one can imagine that AQMs could detect cross traffics 
or traffic anomalies. Moreover, AQM = {KsFi{cwnd), KsFi(Aggfi)} still have well 
behaviours under cross traffic conditions. 
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Figure 4: Time evolution of the queue length, AQM 
{RED, PI, KsF, KsFi(cwnd),KsFi(Aggfi)} Under UDP crossing traffic 



5 Conclusion 

In this preliminary work, we have proposed the design of an AQM for the congestion 
control in communications networks. The developed AQM has been constructed using 
a dynamic state feedback control law. An integral action has been added to reject the 
steady state error in spite of disturbance, d{t) (cross traffic). Finally, the AQM has been 
validated using NS simulator Future work consist in the improvement about control 
laws (theoritical part) extended to a greater network using a decentralized approach to 
reduce the weakness of this method on one side and validation on emulation platform 
(experimental part) on the other side. 
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